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SYSTEMS AND METHODS OF MESSAGE QUEUING 



PATENT 



RELATED APPLICATION 

5 This application claims the benefit of U. S. Provisional AppUcation No. 

60/162,927, filed November I, 1999, the disclosure of which is hereby incorporated by 
reference. 

FIELD OF THE INVENTION 

The present invention is generally related to the field of network messaging, and 
10 in particular to queues. 

BACKGROUND 

The increased growth of the software industry has made a large variety of 
applications available to the public, and the pubhc has learned to rely heavily upon 
these applications. Furthermore, it is common for businesses to employ multiple 

15 applications within their companies for day-to-day activities. Because these 
applications are provided by various vendors, coordination to support routine business 
operations becomes a daunting task often requiring manual labor provided by resources 
that could be used elsewhere. Thus, it is important for businesses to enable their 
appUcations to communicate and share information in an efficient and secure manner. 

20 While businesses need the ability to integrate their appUcations to coordinate 

and share information, business also want to minimize the costs in performing such 
integration. One common problem with conventional approaches is that business are 
forced to purchase custom message queues that are expensive and difficult to integrate 
into their existing systems. As the business changes, these custom queues must be 

25 replaced or updated costing even more time and expense. 

An additional problem with conventional approaches is that system managers 
are faced with the burdensome task of attempting to manage a variety of data store 
components. Messages are difficult to track both during normal communication 
processes as well as during times of system failure. 

30 An additional problem with conventional approaches is that they permit 

duplicate processing of messages. In some applications, it is imperative that a message 



-1- 



is processed only once. For example, a financial application should only debit a user's 
account once for each transaction. Duplicate processing of messages results in 
inaccurate information and requires vast amounts of resources to restore data to its 
proper state. 

5 A further problem with conventional approaches is that the queues are often 

overworked causing bottlenecks within the system. 

SUMMARY OF THE INVENTION 
One embodiment of the present invention is a message queue management 
system configured to manage a first message queue of a first data store type and a 

10 second message queue of a second data store type, wherein the first message queue and 

the second message queue exhibit consistent behavior across a plurality of computer 
mediums. The message queue management system comprises a joumalling module 
configured to track and manage message states of messages stored in the first message 
queue and the second message queue including a joumalled state whereby joumalled 

15 messages are retained in the first message queue and the second message queue. The 
message queue management system also comprises a once-only message processing 
module configured to track a plurality of message states to prevent re-processing of 
previously processed messages stored in the first message queue and the second 
message queue. In addition, the message queue management system further comprises 

20 an extended storage module configured to retain the message in the first message queue 
and the second message queue when the joumalling module specifies a joumalled state 
and an interoperating module configured to coordinate interactions between the first 
message queue and the second message queue to perform data recovery on the first 
message queue and the second message queue upon the event of a failure. The message 

25 queue management module also comprises a once-only message processing module 

configured to track a plurahty of message states to prevent re-processing of previously 
processed messages stored in the first message queue and the second message queue. In 
addition, the message queue management module comprises an interoperability module 
configured to coordinate interactions among the plurality of queues enabling a 

30 distributed workflow and a recovery module configured to perform data recovery on the 

plurality of queues upon the event of a failure. The message queue management module 
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also comprises a central managing module configured to provide single point control of 
the plurality of queues, wherein the single point control includes controUing a plurality 
of publishers and a plurality of subscribers and a load balancing module configured to 
designate a subset of the plurality of subscribers to at least the first message queue in a 
5 subscriber pool such that messages in the first message queue are processed by a first 
available subscriber in the subscriber pool. 

Another embodiment of the present invention is an inteUigent queue used to 
facihtate communication among a set business application programs. The intelligent 
queue may interact with a variety of business application programs using a variety of 

10 data store products. The inteUigent queue provides extended message storage, once- 
only processing, and/or detailed message state information that tracks the status of 
messages fi:om both the sender and the recipient's perspective. 

In one embodiment, the present invention is a message queuing system for 
computer networks that provides rehable communication, ensures non-repetitive 

15 delivery, and is implemented in a medium-independent environment. The message 

queuing system comprises a message queue configured to run on one of a plurality of 
environments and to store messages received fi-om message pubhshers. In addition, the 
message monitors retrieval by a plurality of message subscribers wherein a message is 
retained in the message queue after at least one of the plurality of message subscribers 

20 has accessed the message to permit additional access to the message. A message state 
module is configured to track message states of a message, wherein message state 
information indicates whether the message has been made available to and retrieved by 
at least one of the plurahty of the message subscribers. A recording module is 
configured to selectively retain the message state information related to corresponding 

25 messages at least until the message is removed from the message queue. An interface 
module is configured to receive and send a plurahty of types of data objects in messages 
and to communicate with a plurality of types of data messaging systems that act as 
message publishers or message subscribers. 

Another embodiment of the present invention is a method of message queuing 

30 among a plurality of message pubhshers and a plurahty of message subscribers. The 
method comprises receiving a data object from a message pubhsher intended for at least 
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one message subscriber; processing the data object to create a corresponding message 
wherein the corresponding message includes the data object and message information, 
storing the message in a message queue; tracking the status of the message from the 
perspective of the message pubhsher, tracking the status of the message from the 
5 perspective of the at least one message subscriber, and selectively retaining the message 
to remain in the message queue after the message has been retrieved by the at least one 
message subscriber. 

An additional embodiment of the present invention is a method for joumalling a 
plurahty of messages in a message queue, wherein the plurahty of messages include a 

10 plurality of corresponding message states. The method comprises receiving a message, 

wherein the message includes a pubhsher message state and a subscriber message state. 
The method also comprises placing the message in a message queue and changing the 
pubhsher message state of the message to a joumalled state. In addition, the method 
comprises retaining the message in the message queue. 

15 Another embodiment of the present invention is a method of subscriber pooling 

a plurality of messages in a message queue, wherein the plurality of message includes 
corresponding publisher states. The method comprises placing a message in a message 
queue, informing a plurality of subscribers that the message is available, and upon 
retrieval by one of the plurality of subscribers, preventing other of the plurality of 

20 subscribers from retrieving the message by changing the publisher message state to a 
terminal state. 

An additional embodiment of the present invention is a system for message 
queuing among a plurality of message publishers and a plurality of message subscribers. 
The system comprises a message queue module configured to communicate with a 

25 plurality of message publishers and a plurality of message subscribers and to receive a 
data object from a message pubhsher intended for at least one of a plurality of message 
subscribers. A data object processing module is configured to process the data object to 
create a corresponding message, wherein the corresponding message includes the data 
object and message information. A publisher tracking module is configured to track the 

30 status of the message from the perspective of the message publisher. A plurality of 
subscriber tracking modules are configured to track the status of the message from the 
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perspective of the at least one of a plurality of intended message subscribers. A 
message tracking module is configured to selectively retain the message to remain in the 
message queue after the message has been retrieved by the at least one of a plurality of 
intended message subscribers. 

5 Another embodiment of the present invention is a method for queuing messages 

received from a pubUsher for retrieval by a subscriber comprising storing messages 
using a queue and a queue interface module, wherein the queue interface module is 
configurable to interface with a plurality of database protocols, extending message 
storage beyond the time in which the message has been retrieved by all intended 

10 subscribers, and tracking message states to enforce once-only delivery. 

Another embodiment of the present invention is a method for restoring message 
communication between a first message queue implemented using a first type of data 
store and a second message queue implemented using a second type of data store. The 
method comprises processing the first message queue to locate messages that have not 

15 been revealed. For messages that have not been revealed, path information is extracted 
to find message parents of the message. The message parents' states in the second 
message queue are inspected. Message parents are marked as "done," and the message 
is "revealed" if at least one of the parent messages is marked "done." In addition, the 
method comprises marking all message parents "clean" and the message "deleted" when 

20 the parent messages are not marked "done," marking the message "revealed" if there are 
no parents. Also, messages marked "clean" are recovered and the second message 
queue is processed to find messages that are marked "fetched" but not "done." 
Furthermore, messages in the second message queue that are marked "fetched" but not 
"done" are marked as "clean." 

25 Another embodiment of the present invention is a system for queuing messages 

received from a publisher for retrieval by a subscriber comprising means for storing 
messages using a queue and a queue interface module wherein the queue interface 
module is configurable to interface with a plurality of database protocols, means for 
extending message storage beyond the time in which the message has been retrieved by 

30 all intended subscribers, and means for tracking message states to enforce once-only 
delivery. 
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For purposes of summarizing the invention, certain aspects, advantages, and 
novel features of the invention are described herein. It is to be understood that not 
necessarily all such advantages may be achieved in accordance with any particular 
embodiment of the invention. Thus, for example, those skilled in the art v^ill recognize 
5 that the invention may be embodied or carried out in a manner that achieves one 
advantage or group of advantages as taught herein without necessarily achieving other 
advantages as may be taught or suggested herein, 

BRIEF DESCRIPTION OF THE DRAWINGS 
Figure lA illustrates a high-level block diagram of one embodiment of an 
1 0 application integration system that includes intelligent queues. 

Figure IB illustrates a high-level block diagram of an additional embodiment of 
an application integration system that includes intelligent queues. 

Figure 2A illustrates a high-level block diagram of an additional embodiment of 
an apphcation integration system that includes intelUgent queues. 
15 Figure 2B illustrates a high-level block diagram of an additional embodiment of 

an application integration system that includes intelligent queues. 

Figure 3 illustrates a high-level diagram of one embodiment of an intelligent 

queue. 

Figure 4 illustrates a flowchart of one embodiment of a state diagram for 
20 message states. 

Figure 5 illustrates one embodiment of a message information record. 
Figure 6 illustrates a flowchart of one embodiment of a receive message process. 
Figure 7 illustrates a flowchart of one embodiment of an update message state 
process. 

25 DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

A system and method which represent one embodiment and example application 
of the invention will now be described with reference to the drawings. Variations to the 
system and method which represent other embodiments will also be described. In one 
disclosed embodiment, the system and method are used to allow communication among 
30 a set of business application programs. 
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For purposes of illustration, one embodiment will be described in the context of 
business application programs. The inventors contemplate that the present invention is 
not limited by the type of programs discussed, and that the types of objects may include 
any program, such as, for example, a software module, a business application program, 
5 a database, an accounting program, a music program, a telephone system, and so forth. 
The figures and descriptions, however, relate to an embodiment of the invention 
wherein the program is a business application program. Furthermore, it is recognized 
that in other embodiments, the system and method for message queuing may be 
implemented as a single module and/or implemented in conjunction with a variety of 

10 other modules and the like. Moreover, the specific implementations described herein 
are set forth in order to illustrate, and not to limit, the invention. The scope of the 
invention is defined by the appended claims. 

These and other features will now be described with reference to the drawings 
summarized above. The drawings and the associated descriptions are provided to 

15 illustrate embodiments of the invention, and not to hmit the scope of the invention. 

Throughout the drawings, reference numbers may be re-used to indicate correspondence 
between referenced elements. In addition, the first digit of each reference number 
indicates the figure in which the element first appears. 

In an application integration system, a novel inteUigent queue may be used to 

20 facilitate communication among a set business application programs. In one 
embodiment, the inteUigent queue may interact with a variety of business apphcation 
programs using a variety of data store products. The intelligent queue provides 
extended message storage, once-only processing, and/or detailed message state 
information that tracks the status of each message from both the sender and the 

25 recipient's perspective. 

A benefit of one embodiment is that the inteUigent queues are medium- 
independent in that they may use a variety of data store components, such as, for 
example, a B+ tree, the Sybase CT Lib database, the Oracle OCI database, the Oracle 
AQ database, an IBM-MQ Series database, the Microsoft MSMQ database, a flat file 

30 directory, and so forth. Thus, while a system administrator may be managing five 

different queues implemented with different data store products, the five inteUigent 
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queues may behave and interact the same regardless of the underlying data store. In 
addition, this flexibility allows businesses to use existing commercial products to 
support their intelligent queues and to have the ability to change data stores without 
having to disrupt and reorganize the entire system, 
5 An additional benefit of one embodiment is that the intelligent queue is easily 

managed in a large-scale environment. A large enterprise may employ hundreds of 
inteUigent queues. Thus, the ability to use a single type of queue throughout the system 
affords the system administrator the abiUty to perform message tracking while dealing 
with only one type of queue, regardless of the underlying data store. 

10 Another benefit of one embodiment is that the intelligent queue provides a way 

to track the state of its messages allowing system managers to know the status of a 
message from both the sender and the recipient's perspective. In addition, knowledge of 
the message states allows the messages to be recovered and resent after system failure. 
Furthermore, a message's state may be changed to designate activity rather than tying 

15 up system resources to move a message to a different location or to delete a message. 

InteroperabiUty between queues implemented using different data stores is also 
provided. Regardless of the type of data store, the messages may be recovered in event 
of a system failure. 

A further benefit of one embodiment is that the intelligent queue provides 
20 extended message storage. System administrators may specify when a message should 

be removed from the intelligent queue allowing messages to remain in the intelligent 
queue even after all subscribers to the message have processed the message. Thus, 
system administrators have time to track, distribute, archive, edit, and perform other 
administrative tasks, as necessary. Furthermore, when system failure occurs, system 
25 administrators are able to view the messages in the queue and perform the appropriate 

message recovery. The inteUigent queue can make available unprocessed messages to 
the appropriate application without exposing messages that have already been 
processed. 

An additional benefit of one embodiment is that the intelligent queue may 
30 provide load balancing through the use of subscriber pooling. A message may be made 
available for several recipients such that the first available recipient processes the 
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message maximizing resources and improving message queuing efficiency. The 
intelligent queue may also enable recipients to be designated as members of a subscriber 
pool. In addition, a combination of load balancing and publish/subscribe operations 
may be used to improve efficiency. For example, the members of the subscriber pool 
5 may subscribe to messages in the intelligent queue in parallel with recipients not in the 
subscriber pool. 

Another benefit of one embodiment is that the intelHgent queue may be centrally 
managed allowing for a remote user to perform maintenance and monitoring of the 
various intelligent queues. 

10 The intelligent queue ("IQ") provides persistent data storage for facilitating 

communication among a variety of applications and components. The following 
example illustrates the IQ in operation in publish/subscribe mode. Figure 1 A illustrates 
a transaction system that includes a point of sale system 110 that sends a transaction for 
credit approval by an automated credit approval system 120. First, the point of sale 

15 ("POS") module 130 receives a transaction from the point of sale system 110 and 

converts the transaction into a standard message format. The point of sale module 130 
then publishes the message to the Sybase IQ 140, implemented using the Sybase 
database. Next, the customer database module 150 retrieves the message from the 
Sybase IQ 140 and queries the customer database 160 for relevant customer information 

20 (e.g., credit account, banking institution, etc.). Then, the customer database module 150 
adds the relevant customer information to the message and publishes the message to the 
MSMQ IQ 170, implemented using Microsoft's MSMQ queue. Finally, the credit 
approval module 180 retrieves the message from the MSMQ IQ 170 and converts the 
message into a format understood by the credit approval system 120. 

25 Figure IB illustrates another embodiment of a transaction system that includes a 

point of sale system 110 that sends a transaction for credit approval to an automated 
credit approval system 120 as well as to a central management module 190, The central 
management module 190 allows for the management and monitoring of the intelligent 
queues from a remote location. For example, via the central management module 190, 

30 subscribers and pubUshers may be assigned and/or error checking may occur. In one 
embodiment, the central management module 190 may be implemented on a system that 
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is remote from one or all of the intelligent queues. A detailed description of one 
embodiment of a central management module is disclosed in a concurrently filed 
application having the title "SYSTEMS AND METHODS FOR PROVIDING 
CENTRALIZED MANAGEMENT OF HETEROGENEOUS DISTRIBUTED 
ENTERPRISE APPLICATION INTEGRATION OBJECTS " internal reference 
number SOFTECP.014A, which is incorporated herein by reference. Figure 2A 
illustrates a second example transaction system wherein the customer database module 
150 and MSMQ IQs 170 are dupUcated to allow for load balancing. In the second 
transaction system, the Sybase IQ 140 may include messages that may be retrieved by 
any of the customer database modules 150. This load balancing is implemented using 
subscriber pooling such that the first available customer database module 150 may 
process the message. This system decreases the occurrence of bottlenecks, and 
improves the throughput time for messages being retrieved from the Sybase IQ 140. 

Figure 2B illustrates a third example transaction system wherein some of the 
customer database modules 150 and MSMQ IQs 170 are duplicated to allow for load 
balancing and subscriber pooHng while other of the customer database modules 150 and 
MSMQ IQs 170 are in pubUsh/subscribe mode. In the second transaction system, the 
Sybase IQ 140 may include messages that can be retrieved by any of the customer 
database modules 150. This load balancing is implemented using subscriber pooling 
such that the first available customer database module 150 may process the message. 
This system decreases the occurrence of bottlenecks, and improves the throughput time 
for messages being retrieved from the Sybase IQ 140. 

While the examples illustrated in Figures 2A and 2B do not include a central 
management module 190, it is recognized that in other embodiments, the central 
management module 190 may also be included if one or more of the intelligent queues 
is in load balancing mode. Figure 3 illustrates one embodiment of an intelligent 
queue 310. The inteUigent queue 310 includes a set of intelligent queue processes 320, 
an index database 330, and a data store component 340. 

The intelligent queue 310 includes many processes that may be used to add and 
extract information to and from the queue. In one embodiment, the intelhgent queue 
processes include a receive message process 322, an update message state process 324, 
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as well as several other processes 326 that may provide information about messages in 
the queue. The intelligent queue processes 320 are described in greater detail below. 

The index database 330 stores the message state information for each message 
that is published to the queue. In one embodiment, ttie index database 330 is 
implemented using a flat file structure and updated each time a message state is 
changed. The index database 330 may communicate with an archive database (not 
shown) in which information is stored on a periodic basis, such as, for example, hourly, 
daily, weekly, bi-weekly, and so forth. The index database 330 may be used after a 
system failure to determine the status of each message before and after the failure and to 
provide information on how the system should be restored. 

The data store component 340 is the component that stores the messages for 
retrieval by the subscribers. The data store component 340 acts as a temporary storage 
unit wherein messages may be pubhshed and stored until all of the subscribers are able 
to fetch and process the messages. 

While the index database 330 and the data store component 340 are represented 
as two separate data structures, it is recognized that in other embodiments, the index 
database 330 and the data store component 340 may be combined and/or implemented 
using the same data structure. For example, the index database 330 and the data store 
component 340 may be implemented as sets of tables within the same relational 
database. Furthermore, it is recognized that a variety of data structures may be used to 
implement the index database 330 and/or the data store component 340, such as, for 
example, Unked lists, flat files, binary trees, B+ trees, arrays, queues, databases, and so 
forth. In addition, different types of databases may be used, such as, relational 
databases, object oriented databases, hierarchical databases, and so forth. Further, 
several commercial data store products may also be used, such as, the Sybase CT Lib 
database, the Oracle OCI database, the Oracle AQ database, an IBM-MQ Series 
database, the Microsoft MSMQ database, Microsoft Access, Oracle, Paradox, Fox Pro, 
Microsoft® SQL Server, as well as other proprietary databases. 

While the intelligent queue 310 in Figure 3 is implemented using several 
components, it is recognized that in other embodiments, the intelhgent queue 310 may 
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be implemented as a single component 310, such as a proprietary data store component 
340 that includes an index database 320 as well as the intelligent queue processes 320. 

The intelligent queue 310 may run in a variety of modes, such as the 
pubhsh/subscribe mode, the load balancing mode, and/or the combination mode. 
5 The inteUigent queues 310 may perform in a pubhsh/subscribe mode wherein a 

publisher places a message in the inteUigent queue that is to be retrieved by one or more 
subscribers. This publish/subscribe mode avoids duphcation of messages as only a 
single instance of the message is saved in the queue even though it is to be accessed by 
several subscribers. 

10 The inteUigent queues 310 may also perform in a load-balancing mode wherein 

the inteUigent queue permits subscriber pooling. In load-balancing mode, the inteUigent 
queue 310 may receive a message from a pubhsher that is intended for one of several 
subscribers. The pubhsher does not care which subscriber fetches the message, so long 
as the message is not fetched by more than one subscriber. The load-balancing feature 
1 5 shortens the length of the average queuing period and helps to alleviate bottlenecks. 

The intelligent queue 310 may be configured to run in pubUsh/subscriber mode 
at all times. In another embodiment, the inteUigent queue 310 may be configured to run 
in load-balancing mode at all times, or in another embodiment, the inteUigent queue 310 
may be designed to run in load-balancing mode upon the trigger of some event, such as, 
20 for example, when network traffic exceeds a predetermined threshold. In a fiirther 
embodiment, the inteUigent queue 310 may be designed to run pubUsh/subscribe mode, 
load balancing mode, and a combination mode depending on each individual message. 

The inteUigent queues 310 track message states for each state that a message 
enters. These message states correspond to events that occur from the pubhsher' s 
25 perspective and the subscriber's perspective. Figure 4 illustrates one embodiment of the 
message states and their transitions. 

The intelligent queue provides two classes of message states publisher states 410 
and subscriber states 420. 

The publisher states 410 allow a message publisher to specify the status of each 
30 message after the pubhsher places the message in an intelligent queue. 

PUT: The publisher has placed the message in the inteUigent queue. 
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REVEALED: The publisher has made the message available to the 
subscribers. 

UNAVAILABLE: The message is not available for any subscriber, 
JOURNALLED: All intended subscribers have retrieved the message. The 
5 message will remain in the joumalled state (thus allowing for 

extended message storage time) such that other processing of 
the message may be performed (e.g., archiving by the system 
administrator, retrieval by non-subscribers, etc.). 
The subscriber states 420 allow each message subscriber to specify the status of 
10 each message after the publisher has made the message available in the intelUgent 
queue. Message state information records the status of each message subscriber such 
that a subscriber may be precluded from retrieving a message that it has already 
retrieved. 

GET: The message subscriber has begun the retrieval process. 

15 FETCHED: The message subscriber has retrieved the message 

successfully, but has not yet finished. 
IN PROCESS: The message subscriber is processing the message. 
UNUSABLE: The message subscriber's retrieval of the message has 

failed. 

20 DONE: The subscriber has finished retrieving the message and, 

if necessary, processing the message. 
JOURNALLED: The message subscriber is finished with the message as 
the subscriber has successfiiUy retrieved and, if 
necessary, processed the message, the message retrieval 
25 failed, or the message expired. The message will 

remain in the joumalled state (thus allowing for 
extended message storage time) such that other 
processing of the message may be performed (e.g., 
archiving by the system administrator, retrieval by non- 
30 subscribers, etc.) 
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EXPIRED: The message has expired beyond a pre-specified time limit. 

This state may be automatically controlled or may be 
triggered by the publisher or subscriber. 
In the embodiment illustrated by Figure 4, there are several terminal states, including 
5 the UNAVAILABLE state, the JOURNALLED state, the EXPIRED state, the 
UNUSABLE state, the DONE state, and the JOURNALLED (IMPLIED) state. By 
changing the message states, message can be efficiently joumalled because there is no 
need to copy or remove them into an archived directory. Resources normally required 
to copy or remove messages may be allocated to other tasks, 
10 To illustrate the pubUsh/subscribe mode, assume that Publisher X wants to 

publish a message to be retrieved by Subscriber 0, Subscriber 1, and Subscriber 2. 
PubUsher X may not care about the order in which the messages are retrieved, but wants 
to ensure that all subscribers retrieve the message. In other embodiments, the publisher 
may designate an order in which the messages are retrieved, such as, for example, by 
15 making the message revealed to each subscriber one at a time. 

Referring to the first example, first, PubUsher X places the message in the queue 
as a publish/subscribe message. Next, PubUsher X reveals the message for Subscriber 
0, Subscriber 1, md Subscriber 2. 

Assume that Subscriber 2 then begins processing the message and enters the Get 
20 state. Next, Subscriber 2 fetches the message and proceeds to the Done state and then 

the Joumalled state. 

While Subscriber 2 was in the Fetched state, Subscriber 0 may then begin 
processing the message in the Get state and then fetch the message and proceed to the 
Fetched state. Subscriber 0 may determine that the message is unreadable and then 

25 proceed to the Unusable state and onto the JoumaUed state. Subscriber 0 may then 
inform PubUsher X that it was unable to fetch the message. 

Finally, Subscriber 1 may begin processing the message in the Get state and then 
move to the Fetched state. Subscriber 1 may then process the message in the In Process 
state and proceed to the Done state and then to the Joumalled state. 

30 After Subscriber 0, Subscriber 1, and Subscriber 2 have all entered the 

JoumaUed state. Publisher X then proceeds to the Joumalled State. 
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To illustrate the load balancing mode, in this example, assume that PubUsher X 
wants to publish a message to be retrieved by Subscriber 0, Subscriber 1, or Subscriber 
2. Publisher X does not care which subscriber retrieves the message, but would like it 
retrieved by the first available subscriber. First, Publisher X places the message in the 

5 queue as a load/balancing message. Next, Publisher X reveals the message for 

Subscriber 0, Subscriber 1, or Subscriber 2. Assume that Subscriber 2 then begins 
processing the message and enters the Get state. The state of the message for 
Subscriber 0 and Subscriber 1 changes to Expired and then to Joumalled allowing 
Subscriber 0 and Subscriber 1 to process a different message when they are free. As 

10 soon as Subscriber 2 has successfully fetched the message and moves to the Joumalled 
state, PubUsher X changes the state of the message to Joumalled. 

While the above examples illustrate inteUigent queues that process messages 
designated in either publish/subscribe mode or load balancing mode, it is recognized 
that the message may be designated as a combination of both. For example, Publisher 

15 X may want to pubUsh a message to be retrieved by Subscriber 0 or Subscriber 1, 

Subscriber 2, and Subscriber 3. Thus, in the end, either Subscriber 0, Subscriber 2, and 
Subscriber 3 should have the retrieved message, or Subscriber 1, Subscriber 2, and 
Subscriber 3 should have the message. 

First, Publisher X places the message in the queue. In one embodiment, the 

20 intelligent queue may treat this as two messages, one message using load balancing 
between Subscriber 0 and Subscriber 1 with the other message using pubUsh/subscribe 
mode with Subscriber 2 and Subscriber 3. In another embodiment, the publisher may 
designate to which subscribers the message is revealed. Thus, after Subscriber 0 or 
Subscriber 1 begins processing the message, the message becomes expired the 

25 Subscriber(s) that did not retrieve the message. 

An advantage of one embodiment of this invention is the ability to perform 
message recovery when a system failure occurs. Furthermore, the message recovery 
may also allow for interoperabiUty between inteUigent queues implemented using 
different data stores. In addition, the interoperability may allow for data translation, 

30 interfacing, correlation services, and/or data recovery. The data translation may allow 

data to be translated from one format to another, such as, for example, from MS IQ 
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format to Oracle IQ format. Furthermore, interfacing may include providing connection 
details, such as, for example, network protocols, application programming interface 
calls, long connections, and so forth. The correlation services may include combining 
multiple message into a single message and publishing it to another message queue. 
5 The data recovery may include procedures for restoring the messages in the queue. 

Thus, regardless of the type of data store, the messages may be recovered in event of a 
system failure. 

To illustrate message recovery using the message state information in operation, 
in this example, assume that the system illustrated in Figure 1 A is in the process of 
10 recovering from a system failure. Further, assume that the Sybase IQ 140 is a inbound 
queue and the MSMQ IQ 170 is an outbound queue. When a message is processed by a 
module, the original message is referred to as the parent message and the processed 
message is referred to as the child message. The following provides one embodiment of 
a set of recovery logic steps that may be used to restore the system. 
1 5 Step 1 : Go through the MSMQ IQ 170 to find messages that are not marked 

"Revealed." These messages have "Clean" state. 
Step 2: Once a "Clean" message is found extract the path information to find 
the parents of the message. If the message does not have parents, go 
to Step 4. 

20 Step 3: Go to the Sybase IQ 140 to check each parent message's state. If one 

of the parent messages is marked "Done," then mark all parent 
messages "Done" and mark the child message "Revealed." If none 
of the parent messages is marked "Done," then mark all parent 
messages "Clean" and mark the child message "Deleted." 

25 

Step 4: If the message does not have parent, mark this message "Revealed." 

Step 5: After the "Clean" messages in the MSMQ IQ 170 are processed 
("recovered"), go through the Sybase IQ 140 to find messages that 
are marked "Fetched" but not "Done." Mark these "Fetched but not 
30 Done" messages "Clean." 
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Thus, if the POS module 130 fails, the following guidelines may be used to recover the 
messages. 

Scenario 1: If a message is published onto the Sybase IQ 140 and message is 
not fetched, then follow Step 1, Step 2, and then Step 4. 
5 Scenario 2: If a message is put onto the Sybase IQ 140 and message is 

marked "Fetched," then let the subscriber do the recovery. 
If the credit approval module 180 fails, the following guidelines may be used to recover 
the messages. 

Scenario 1: If a message is fetched but not marked "Done " then follow Step 
10 5. 

If the customer database module 150 fails, the following guidelines may be used to 
recover the messages. 

Scenario 1: If a message is fetched from Sybase IQ 140 but not put onto the 
MSMQ IQ 170, then follow Step 5. 
15 Scenario 2: If a message is fetched from the Sybase IQ 140 and put onto the 

MSMQ IQ 170, then follow Step 1, Step 2, and then Step 3. 
Scenario 3: If a message is fetched from the Sybase IQ 140, put onto the 
MSMQ IQ 170, and marked "Done" in the Sybase IQ 140, then 
follow Step 1, Step 2, and then Step 3. 
20 It is recognized that the above recovery logic illustrates one embodiment of 

message recovery using message state information and that other embodiments may be 
used. 

In one embodiment, the message states are recorded in a file that corresponds to 
the message and is stored in the intelligent queue index. It is recognized that in other 
25 embodiments, the message states may be recorded in other data structures, such as, for 

example, a linked list, a finite state machine, a tree, a graph, and so forth. Furthermore, 
in other embodiments, the message state information may be located within the 
message, with information about other messages, and so forth. 

Figure 5 illustrates one embodiment of message object 510. The message object 
30 510 includes message state information, such as, the message identifier, the publisher 

ID, and the subscriber IDs. In addition, for each publisher and subscriber, the message 
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state information includes the time stamp for each state that has already occurred, and 
the current state. It is recognized that in other embodiments, other formats of message 
information and may be used. For example, in one embodiment, the message identifier 
may be assigned by the publisher of the message, whereas in another embodiment, the 
5 message identifier may be automatically generated by the intelligent queue. 

For example, the exemplary message object 510 in Figure 5 was published by 
Pubhsher X in publish/subscriber mode and intended for Subscribers 0-2. Publisher X 
placed the message in the queue at time 12:14:03. Nine seconds later, the message was 
revealed and thus available to be retrieved by the subscribers. Finally, after the message 
10 had been joumalled by all subscribers, the pubhsher joumalled the message at 12:16:09. 

Subscriber 0 started processing the message at 12:14:13. Thirteen seconds later, 
it fetched the message and was done retrieving the message at 12:14:54. Subscriber 0 
then joumalled the message at 12:15:02. 

Subscriber 1 started processing the message at 12:14:25, and sixty one seconds 
] 5 later fetched the message. At 12:15:51, Subscriber 1 began processing the message and 
finished ten seconds later. At 12:16:07, Subscriber 1 joumalled the message. 

Subscriber 2 started processing the message at 12:15:08. At 12:15:32, 
Subscriber 2 fetched the message and at 12:15:44, Subscriber 2 declared the message 
imusable and joumalled the message at 12:15:59. 
20 After the message has been joumalled. Subscriber 2 may inform the publisher 

that it encountered a problem with retrieving the message, and thus, the pubhsher may 
make the message available again for Subscriber 2. 

In addition, if a system failure occurred, the system administrator would know 
that only Subscriber 2 would need the message and that Subscriber 0 and Subscriber 1 
25 had successfiiUy retrieved the message. 

The inteUigent queue 310 includes intelligent queue processes 320 that may be 
used to add and extract information to and fi-om the queue. In one embodiment, the 
intelligent queue processes 320 include a receive message process 322, an update 
message state process 324, as well as several other process 326 that may provide 
30 information about information in the queue. 
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The receive message process 322 receives a message object from a publisher and 
places the message object in the queue. Figure 6 illustrates one embodiment of the 
receive message process 322 wherein a subscriber sends a message object to the 
intelligent queue. 

5 Beginning at a start state (block 610), the receive message process 322 receives 

a message object from a pubUsher (block 620). Next, the receive message process 322 
performs checks on the message object (block 630), such as, for example, error 
detection, error correction, and/or verification of the sender. The receive message 
process 322 then stores the message in the data store (block 640). As discussed above, 

10 the data store may be implemented using a variety of data structures, such as, for 
example, a B+ tree, a flat file directory, a linked Ust, a tree, an array, a database, and so 
forth. Next, the receive message process 322 stores the message information 
corresponding to the message in the index (block 650). In one embodiment, the 
message information may be sent from the pubUsher, while in other embodiments, the 

15 receive message process 322 may derive the message information from the message 

header, default values, and so forth. The receive message process 322 may then 
determine which subscribers are supposed to retrieve the message (block 660). This 
may include determining all of the subscribers that should retrieve the message such as 
in the pubhsh/subscribe mode, as well as all of the subscribers that are ehgible to 

20 retrieve the message such as in the load balancing mode. Finally, for each subscriber, 
the receive message process 322 sends the subscriber an alert informing the subscriber 
that a message is available in the queue (block 670) and proceeds to an end state (block 
680). 

The update message state process 324 receives an update request from a 
25 publisher or subscriber and updates the corresponding message state in the index. 

Figure 7 illustrates one embodiment of the update message state process 324 wherein a 
publisher or subscriber sends an update request to the inteUigent queue. 

Beginning at a start state (block 710), the update message state process 324 
receives an update request from a pubHsher or a subscriber (block 720). The update 
30 request may be in a variety formats, such as, for example, an email, a data structure, a 

data record, a message object, and so forth. Next, the update message state process 324 
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locates the message state information in the index that corresponds to the update request 
(block 730). Finally, the update message state process 324 updates the message state 
information with the updated information (block 740) and proceeds to an end state 
(block 750). For example, the update message state process 324 may add the new time 
5 stamp of the current state to the corresponding state and change the value of the "current 
state" field to the current state. 

It is recognized that in other embodiments, the message state information may 
be automatically updated. For example, when a subscriber retrieves a message, the 
intelligent queue may automatically record the time that the retrieval was made. 

10 The intelligent queue processes 320 may include other process that provide 

information about information in the queue. For example, the intelligent queue may 
include a retrieve message process that retrieves a copy of a message jfrom the queue 
and forwards the copy to a subscriber. The intelligent queue may also include a view 
message process that allows an outside party to view message information and/or 

15 message state information in the queue without making any alterations to the 

information. A set message priority process may also be included that sets the priority 
of a message within the queue, as well as a set of get information processes that retrieve 
designated pieces of information about a message, such as, for example, the message 
subject, the message handle, the message header, and so forth. 

20 It is recognized that various embodiments of the invention may be used and that 

the example provided above is meant only to illustrate various uses of the invention and 
not to limit the scope of the invention. 

While certain embodiments of the invention have been described, these 
embodiments have been presented by way of example only, and are not intended to limit 

25 the scope of the present invention. Accordingly, the breadth and scope of the present 

invention should be defined in accordance with the following claims and their equivalents. 
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WHAT IS CLAIMED IS ; 

1 . A message queue management system configured to manage a plurality 
of queues including a first message queue of a first data store type and a second 
message queue of a second data store type, wherein the first message queue and the 
5 second message queue exhibit consistent behavior across a plurality of computer 

mediums, the message queue management system comprising: 

a joumalling module configured to track and manage message states of 
messages stored in the first message queue and the second message queue 
including a joumalled state whereby joumalled messages are retained in the first 
10 message queue and the second message queue; 

a once-only message processing module configured to track a pluraHty of 
message states to prevent re-processing of previously processed messages stored 
in the first message queue and the second message queue; 

an interoperability module configured to coordinate interactions among 
1 5 the plurality of queues enabhng a distributed workflow; 

a recovery module configured to perform data recovery on the pluraHty 
of queues upon the event of a failure; 

a central managing module configured to provide single point control of 
the plurality of queues, wherein the single point control includes controlling a 
20 plurality of publishers and a plurality of subscribers; and 

a load balancing module configured to designate a subset of the plurality 
of subscribers to at least the first message queue in a subscriber pool such that 
messages in the first message queue are processed by a first available subscriber 
in the subscriber pool 

25 2. The message queue management system of Claim 1, wherein the load 

balancing module is further configured to enable the subscribers to subscribe to at least 
the first message queue in parallel with subscribers not in the subscriber pool. 

3. A message queuing system for computer networks that provides reliable 
communication, ensures non-repetitive delivery, and is implemented in a medium- 

30 independent environment, the message queuing system comprising: 
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a message queue configured to run on one of a plurality of environments 
and to store messages received from message publishers and monitor retrieval 
by a plurality of message subscribers wherein a message is retained in the 
message queue after at least one of the plurality of message subscribers has 
accessed the message to permit additional access to the message; 

a message state module configiired to track message states of a message 
wherein message state information indicates whether the message has been made 
available to and retrieved by at least one of the plurality of the message 
subscribers; 

a recording module configured to selectively retain the message state 
information related to corresponding messages at least until the message is 
removed from the message queue; and 

an interface module configured to receive and send a plurality of types of 
data objects in messages and to communicate with a plurality of types of data 
messaging systems that act as message pubhshers or message subscribers. 

4. The message queuing system of Claim 3, wherein at least one of the 
plurality of the data messaging systems acts as both a message publisher and a message 
subscriber. 

5. The message queuing system of Claim 3, wherein the message queue is 
fiirther configured to provide load balancing. 

6. The message queuing system of Claim 5, wherein the load balancing is 
implemented using subscriber pooling. 

7. The message queuing system of Claim 3, wherein the message state 
information is used to ensure that messages are acquired in the designated order by at 
least one of the plurahty of message subscribers. 

8. The message queuing system of Claim 3, wherein a message is intended 
for a single message subscriber. 

9. The message queuing system of Claim 3, wherein a message is intended 
for a plurality of message subscribers. 

10. The message queuing system of Claim 3, wherein the message is deleted 
from the message queue during a designated clean up process. 



-22- 



11. The message queuing system of Claim 3 , wherein the message is retained 
in the message queue to assist in recovery of messages during a system failure. 

12. The message queuing system of Claim 3 , wherem the message is retained 
in the message queue to assist in at least one of archiving of the message, manual 
distribution of the message, editing of the message, or resending of the message. 

13. The message queuing system of Claim 3, wherein a message is intended 
for a plurality of message subscribers. 

14. The message queuing system of Claim 3, wherein the message state 
information includes message pubhsher state information and corresponding message 
subscriber state information. 

15. The message queuing system of Claim 14, wherein the message state 
information is stored within the message. 

16. The message queuing system of Claim 3, wherein the message states 
reflect the message publisher's status of the message in relation to the intended message 
subscribers and an mdividual message subscriber's status of the message in relation to 
the corresponding individual message subscriber. 

17. The message queuing system of Claim 3, wherein the message state 
includes a sequence number, publisher state information, and subscriber state 
information. 

18. The message queuing system of Claim 17, wherein the publisher state 
information includes information relating to an "unrevealed" state, information relatmg 
to a "revealed" state, mformation relating to an "unavailable" state, and information 
relating to a "joumalled" state. 

19. The message queuing system of Claim 17, wherein the subscriber state 
information includes information relating to a "get" state, information relating to a 
"fetched" state, infoimation relatmg to an "unusable" state, information relating to an 
"expired" state, information relating to an "inprocess" state, information relating to a 
"done" state, and information relating to a "joumalled" state. 

20. The message queuing system of Claim 3, wherein the message queue is 
configured to interface with a plurality of different database protocols. 
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21. The message queuing system of Claim 3, wherein at least one of the 
types of a plurality of data messaging systems is a database. 

22. The message queuing system of Claim 3, wherein at least one of the 
types of a plurality of data messaging systems is a flat file directory. 

23. The message queuing system of Claim 3, wherein at least one of the 
types of a plurality of data messaging systems is a second message queuing system. 

24. The message queuing system of Claim 3, wherein at least one of a 
plurahty of data objects is a database record. 

25. The message queuing system of Claim 3, wherein at least one of a 
plurality of data objects is an electronic mail message. 

26. The message queuing system of Claim 3, wherein at least one of a 
plurality of data objects a web page. 

27. A method of message queuing among a plurality of message publishers 
and a plurality of message subscribers, the method comprising: 

receiving a data object from a message publisher intended for at least one 
message subscriber; 

processing the data object to create a corresponding message wherein the 
corresponding message includes the data object and message information; 

storing the message in a message queue; 

tracking the status of the message from the perspective of the message 
publisher; 

tracking the status of the message from the perspective of the at least one 
message subscriber; and 

selectively retaining the message to remain in the message queue after 
the message has been retrieved by the at least one message subscriber. 

28. The method of Claim 21, wherein the message queue is configurable to 
run on a plurality of platforms, 

29. The method of Claim 27, wherein the message queue is configurable to 
provide load balancing. 

30. The method of Claim 27, wherein the message queue is configurable to 
provide subscriber pooling. 
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31. The method of Claim 27, wherein the message information includes a 
message identifier and a message header. 

32. The method of Claim 28, wherein the message header includes message 
state information, 

33. The method of Claim 28, wherein the message header includes message 
state information for the message publisher and the at least one message subscriber. 

34. The method of Claim 33, wherein the message information for the 
message publisher includes information related to message publisher states wherein the 
message publisher states include a "put" state, an "unavailable" state, a "revealed" state, 
and a "joumalled" state. 

35. The method of Claim 33, wherein the message information for the at 
least one message subscriber includes information related to message subscriber states 
wherein the message subscriber states include a "get" state, a "fetched" state, an 
"unusable" state, an "expired" state, an "inprocess" state, a "done" state, and a 
"joumalled" state. 

36. The method of Claim 32, wherein the message state information is stored 
in a log that includes time stamps for the corresponding message states. 

37. A method for joumalUng a plurality of messages in a message queue, 
wherein the plurality of messages include a plurality of corresponding message states, 
the method comprising: 

receiving a message, wherein the message includes a pubhsher message 
state and a subscriber message state; 

placing the message in a message queue; 

changing the publisher message state of the message to a joumalled state; 

and 

retaining the message in the message queue. 

38. The method of Claim 37 further comprising changing the subscriber 
message state of the message to a terminal state to prevent re-processing of the message. 

39. A method of subscriber pooling a plurality of messages in a message 
queue, wherein the plurality of message includes corresponding pubhsher states, the 
method comprising: 
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placing a message in a message queue; 

informing a plurality of subscribers that the message is available; and 
upon retrieval by one of the plurality of subscribers, preventing other of 
the plurality of subscribers from retrieving the message by changing the 
5 publisher message state to a terminal state. 

40, A system for message queuing among a plurahty of message publishers 
and a plurahty of message subscribers, the system comprising: 

a message queue module configured to communicate with a plurahty of 
message publishers and a plurahty of message subscribers and to receive a data 
10 object from a message publisher intended for at least one of a plurahty of 

message subscribers; 

a data object processing module configured to process the data object to 
create a corresponding message wherein the corresponding message includes the 
data object and message information; 
1 5 a pubhsher tracking module configured to track the status of the message 

from the perspective of the message pubhsher; 

a plurahty of subscriber tracking modules configured to track the status 
of the message from the perspective of the at least one of a plurality of intended 
message subscribers; and 
20 a message tracking module configured to selectively retain the message 

to remain in the message queue after the message has been retrieved by the at 
least one of a plurality of intended message subscribers. 

41. The system of Claim 40, wherein the message queue module is fiirther 
configured to provide load balancing. 

25 42. The system of Claim 40, wherein the message queue module is fiirther 

configured to provide subscriber pooling. 

43. The system of Claim 40, wherein the message information includes a 
message identifier and a message header. 

44. The system of Claim 41, wherein the message header includes message 
30 state information for the message pubhsher and the at least one message subscriber. 
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45. The system of Claim 40, wherein the message information includes 
message state information, 

46. The system of Claim 45, wherein the message state information is stored 
in a log that includes time stamps for the corresponding message states. 

5 47. A method for queuing messages received from a publisher for retrieval 

by a subscriber comprising: 

storing messages using a queue and a queue interface module wherein 
the queue interface module is configurable to interface with a plurality of 
database protocols; 

10 extending message storage beyond the time in which the message has 

been retrieved by all intended subscribers; and 

tracking message states to enforce once-only delivery. 
48. The method of Claim 47, wherein tracking message states includes 
tracking information related to message pubUsher states and message subscriber states. 
1 5 49. The method of Claim 48, wherein the message pubHsher states include a 

"put" state, an "unavailable" state, a "revealed" state, and a "joumalled" state. 

50. The method of Claim 48, wherein the message publisher states include a 
"get" state, a "fetched" state, an "unusable" state, an "expired" state, an "inprocess" 
state, a "done" state, and a "joumalled" state. 
20 5 1 . A system for queuing messages received from a publisher for retrieval by 

a subscriber comprising: 

means for storing messages using a queue and a queue interface module 
wherein the queue interface module is configurable to interface with a plurality 
of database protocols; 

25 means for extending message storage beyond the time in which the 

message has been retrieved by all intended subscribers; and 

means for tracking message states to enforce once-only dehvery. 
52. A method for restoring message communication between a first message 
queue implemented using a first type of data store and a second message queue 
30 implemented using a second type of data store, the method comprising: 
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processing the first message queue to locate messages that have not been 
revealed; 

for messages that have not been revealed: 

extracting path information to find message parents of the 
5 message; 

inspecting the message parents' states in the second message 

queue; 

marking message parents as "done" and the message "revealed" if 
at least one of the parent messages is marked "done;" 
10 marking message parents "clean" and the message "deleted" 

when the parent messages are not marked "done;" and 

marking the message in the second message queue "revealed" if 
there are no parents; 
recovering messages marked "clean;" 
15 processing the second message queue to find messages that are marked 

"fetched" but not "done"; and 

marking the messages that are marked "fetched" but not "done" as 
"clean." 



-28- 



SYSTEMS AND METHODS OF MESSAGE QUEUING 



ABSTRACT OF THE DISCLOSURE 

An intelligent queue may be used to facilitate communication among a set 
business application programs. In one embodiment, the intelligent queue may interact 
with a variety of business application programs providing consistent service behaviors 
across a variety of data store products. The intelligent queue provides extended message 
storage, efficient joumaUing, interoperability with other inteUigent queues, load 
balancing, once-only processing, as well as detailed message state information that 
tracks the status of each message from both the sender and the recipient's perspective. 
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